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I. IN TBODUCTION 



1. B ACKGROUND 

Khen a computer user, from his terminal, submits a job 
to the computer, it would be desirable for him that the job 
be processed right away. However, this rarely happens in the 
real world, because a computer system usually consists of 
only one Central Processing Unit (CPU) and many terminals. 
So if more than one person uses the computer, there will be 
jobs that request processing at the same time. Hence, seme 
kind cf queueing system or time-sharing technique will be 
needed to organize the allocation of processing time to 
those submitted jobs. 

Generally, a computer system has two types of processing 
time allocation. One is called ’’Batch Processing”. All the 
jobs submitted this way form a kind cf queue and wait to be 
served (processed) according to the well knewn 

First-Ccme-First-Served (FCFS) policy, i. e. the first 
submitted job is processed to completion, then the computer 
is set up for the next waiting job; in some systems a 
priority policy based on the length of a job is used to 
determine the next job to get dedicated use of the 
processor. The other one which’ is of interest for this 
thesis is called ’’Time-Sharing Processing”. It is based on 
a technique that permits concurrent processing of twe or 
more jobs. Each job no matter when it is submitted gets an 
equal share of processing time until completion. 

E. FEOCISSOR-SHARING SYSTEM. 

The so-called "Processor-Sharing” or ’’pure time-sharing" 
in computer engineering is the system in which the processor 
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shares its service (processing time) equally among all icbs 
submitted. In other words, if an individual job reguirir.g a 
certain amount of processing time is tagged and submitted to 
the system and finds (j-1) other jobs being processed, ’ then 
from new or. all j jobs, will each receive service 

(processing time) egual to (1/j)-th of a (processing) time 

unit per time unit. Of course the rate at which submitted 

jobs receive service changes each time a new arrival joins 
the system and each time a completed job departs. 

This abstraction cf computer capacity allocation may be 
described in more formal terms as follows : if the chance 

that any single job, processed alone, finishes in time 
interval (t,t + h) is li-h + o (h) , ( exponential-!! arkov 

service ), then the chance that a particular "tagged" job in 
the ccmpany of (j-1) others finishes in (t,t+h) is 
jA(h/ j) + o (h) as h approaches zero. 

Clearly, there is no waiting line in processor sharing 
cf the abeve type. It permits short jobs access to 
processing right away even if they arrive after longer jobs. 

Processor sharing is an approximation to the processor 
sharing "Round-Robin" model. In this model once a particular 
tagged jcb enters the system, it joins the end of an ordered 
gueue. Shen it reaches the service point it is allocated a 
fixed quantum (g) cf service time. If the job completes 
within this time it simply leaves the system. If after g 
seconds it still reguires more service, it is immediately 
returned to the end of the queue. This process then gees on 
and cn until the required service is completed. 

In the limit, however, as g approaches zero, the 
Round-Robin system becomes the Processor-Sharing system. The 
latter system here will be studied for its characteristics 
relating to the distribution cf response time, i.e. the time 
that a tagged jcb requiring a certain amount of processing 
time actually taken tc complete the service and leave the 
system. 
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c. 



MODEL AND APPROXIMATE DISTRIBUTION 



Apparently the first study of delays to arriving jobs 
under processor sharing was conducted by Coffman, Muntz, and 
Trotter (1970) . [Ref. 1 ] They assumed a steady state M/M/1 
system under processor sharing, i.e. Poisson arrivals and 
exponential service times with a single server processor. 
They then derived an expression for the Laplace transform of 
the waiting time distribution of an arriving job conditioned 
on the processing time it requires and the number of jobs if 
finds in the system on arrival. 

The properties of the response time, R, given the 
processing time required by the arriving job under processor 
sharing system was further analyzed by D. Mitra ( 19 81) 
[Ref. 2] for the following model. A system consisting of N 
terminals and a single computer (CPU) can be modeled as a 
classical machine-repair situation : each thinking terminal 

(failure-prone machine) applies for computer service at rate 
^ , and queued or waiting jobs are served at rate jji as 
long as any jobs are present. If Markov assumptions are made 
throughout, then X (t) , the number of jobs at the service 
stage, is a birth and death process with transition rates : 



X(t) = j — -> X(t+h) = j + 1 

> X (t+h) = j - 1 

> X (t+h) = j 



X-h + o(h) 

|Jlj h + o(h) (1.1) 

1 - ( Xj + ^ ) h + c (h) 



where X^ = X(N-j) is the rate at which 

submitted tc the computer when there are already 
the system, and jaj 



r 



for j > 1, otherwise being 



a job 


is 


j jobs 


in 


zero , 


is 
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the rate at which the computer gives service to all j jobs 
submitted. Based on the above transition rates, the distri- 
bution of response time under processor sharing is 
characterized, and the moments such as mean and variance are 
found under interesting conditions, i.e. the conditional 
response time, given only the processing requirement T time 
units, derived from the condition that the tagged job 
requiring T time units of processing arrives to find (j-1) 
ethers in the system. [ Bef . 2] 

Gaver, Jacobs and Latouche [Ref. 3] have generalized and 
extended the previous analysis by introducing the idea of 
processor sharing in an arbitrary birth and death process 
environment, thus allowing quite general terminal-computer 
interactions to be represented. In the process, the meaning 
cf ’’system state at the moment of tagged job arrival” is 
also clarified by Lavenberg and Reiser. [Ref. 4] Response 
time characteristics are computed under the assumptions that 
proce s scr-shari n g service rates are processcr-s tate- 

depsndent in a more general way than that described earlier; 
this ' allows for approximate representation of overhead 
penalties and also of job scheduling. Other characteristics 
of tagged job response are also studied, e.g. the accumu- 
lated prccessing work, W(t')r actually performed on that job 
by elapsed time t*, with t* < T (T = required processing 
time) following job introduction; note that W(R) = T, so 
the first passage of W(t*) to T is actually the response 
time. although differential equations may be obtained for 
transforms cf W(t') under various initial conditions, and 
hence, implicitly for its distribution, the results are far 
from being explicit and informative. However, central limit 
theorems for additive functionals of Markov processes, or 
for cumulative processes, allow the conclusion that the 
accumulated work accomplished by fixed time t 1 on a "long” 
job is also approximately normally distributed. 
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Additionally, a noriral approximation is shown to be valid 
for the simple modal — and probably for others as well-- 
when the number cf competing terminals becomes large , i.a. 
under heavj traffic conditions. The quality of the normal 
approximations for finite job lengths and for a finite 
number of terminals will be assessed by simulation me+hcds 
in chapter IV of this thesis. 

The differential equations for the mean and moments of 
the response time of a tagged job requiring a fixed amount 
cf processing time, given that it enters to find an initial 
number cf ether jobs being processed, will be derived in 
chapter II. To remove the condition of initial system state, 
we will use the steady-state distribution of the number of 
jobs at the service stage. This will also be explained in 
the same chapter. A procedure to simulate the response time, 
given again an initial system state, will be described in 
chapter III. The empirical response times obtained from 
simulation will then be considered as stratified random 
samples. Fence, a method of computing the central moments 
will be given accordingly. 

In chapter V, we will study a bivariate birth and death 
process model for a computer system having two types of 
terminals. This model allows relaxation of the independent 
identically distributed exponential service requirement and 
terminal think times of the model described by Mitra. 
[Bef. 2] Under the same conditions as the previous simple 
model with one job type, we will derive normal approxima- 
tions for the distribution cf the response rime of a tagged 
job requiring t units cf processing time. As before, simu- 
lation methods will be used to assess the accuracy of normal 
approximation to the distribution of the response time. 



II. H i AN AND MG BENTS FOB A SINGLE JOB TYPE MODEL 
A. INTRODUCTION 

In this chapter, we consider the birth-death procsss 
model with rates in (1-1), Even though the unconditional 
mean and variance of response time of a Processor-Sharing 
system may te obtained by deriving the Laplace transform of 
the equilibrium waiting time distribution [Ref. 1 ] it is 
also interesting to develop seme results for the conditional 
expectation of response time of a job requiring T units of 
processing time, since in the real world one might rather 
wonder hew long a job that requires certain amounts of 
processing time will te delayed after being submitted tc the 
system. 

We will show that the equilibrium mean waiting time in 
the Processor-Sharing system varies linearly with the 

service time requirement T, i.e. E (X) = AT/( p (1- A/p )) , 

as T > oo. Thus for arrivals having a service time 

requirement less than the average, i.e. T < 1/p , the mean 

response time is less in the Processor-Sharing system than 
in the First-Come-First-Ser ved system. 

Tc derive the conditional mean response time, a given 
tagged job, i.e. a particular job that enters to find (j-1) 
ethers waiting for service time, and that requires "T" units 
cf processing time will be considered. Then under Markov 
assumptions a system of differential equations will be 
established to allow computation of the conditional mean 
response time by numerical methods. Other moments may also 
be obtained by means of solving other systems of 
differential equations. 
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CONDITION ON REQUIRED TIME AND SYSTEM STATE 



E. 



Under the assumptions of a Markov process, i.e. tirth 
and death process, on the number of jobs at the service 
stage of a system of n N" terminals and a single computer 
(CPU) with transition rates as in equation (1.1) , a system 
cf differential equations for the mean response time may be 
derived as follows. 

let R refer to the response time of a newly arrived 
job, and 

m.(T) = E[ R l X (0) = j, W ( 5) = T] , ’ (2.1) 

J 



the conditional expectation of the response time, given that 
the tagged job is initially in the company of (j-1) others, 
i.e. arrives to find (j-1) jobs present, and requires 
"work” or processing time equal to T. 

Let Xj and be as in (1.1). Consider all the 

possible system changes in (0,h), and subsequently; any of 
the following mutually exclusively events may occur; 

(a) new job arrival, bringing the state to j+ 1 , an 

event cf probability X*h# 

4 

(b) accompanying job departure and return to think mode, 
an event of probability (j-1)|jl (r(j)/j)h, 

(c) nc change in accompanying system state but a reduc- 

tion in remaining tagged-job service of (r ( j) /j) h , an event 
cf probability 1- ( Xj + ( j-1) (r(j)/j))h. 

All ether possible events are of probability o (h) and 
may be ignored. 

The term r(j) used above represents the fraction of time 
the processor actually spends processing when there are j 
jobs being processed. The fact that r(j) < 1 represents 
overhead. 

1 

\ 

1 3 



letting f*j = ( j- 1) p (r ( j) / j) , (a) , (b) a 
ro j (1) = h+m. (T-(r(j)/j)h )[1-(X^ + pj)h] 



(b) and (c) lead tc : 



( 2 . 2 ) 



♦ ^ 4 hm j+t ( T ~ < r (j)/ j) h) + pjhm^CT- (r(j)/j) h) +o (h) . 



Subtract m • (T- (r ( j) / j) h) from each side , then divide by h 

sJ 

and let h > 0 to get the differential equations. : 



This is a standard system of linear differential equa- 
tions , initial conditions are m- (0) = 0 for all j . A 

solution can be cbtained in terms of Laplace transforms, by 
exponential formulas involving matrices, or, numerically, by 
use of standard computer codes for the solution of systems 
cf linear differential equations. Simple explicit and 
compr ehensi tie closed form results do not seem attainable. 

C. CONDITION OH REQUIRED TIME 

The condition that the tagged job entered to find < j — 1 ) 
ethers in the system, i.e. X(0) = j, can be removed 

according to the stationary distribution that corresponds to 
the system state found by the arriving job. The resulting 
expressicn allows the conclusion that the expected response 
time is "li nea r" in the required processing time, T. The 
result here holds for quite general birth-and-death process 
model, not only for the simple machine- repair setup detailed 
here . [ Ref . 5 ] 



(r ( j) /j) m^ (T) = 1 - ( ) b^(T) 



( 2 . 3 ) 
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The derivation cf linearity of the expected response 
time is developed, in outline, as follows. 

First, observe that the long-run distribution cf X(0), 
i.e. the number of jobs present (including the tagged job) 
just after the taggec job enters , is 

g j — c *TTj ___ t = c r ( j) rj = i»2,...,N (2.4) 



where c is selected sc that the q ' s sum to one, and for all 

j*s, = "n“ 0 o^ 0 x,* • • Xj« t ) / (p»^2 # * * Ki ) 15 the stationary 

distribution (assumed to exist) of the Markov chain X(t), 
i.e. the number of jobs at the service stage, with rates as 
in (1.1) with = |J r (j) . The equation (2.4) is intui- 

tively apparent, fcr the long-run probability that a 
transition from j-1 tc j occurs in (t,t + h) is TT; k X- as 

h > 0 and hence eguation (2.4) follows by normalization. 

A formal proof can be provided based either upon an embedded 
Markov chain formulation, or upon the theory of additive 
functionals of a Markov process. [Ref. 6] The distribution 
^ q^ has also been civen by Kelly. [Ref. 7] 

Next, use equation (2.4) to remove the condition that 
X (0) = j. Fut 

N 

m(I) = E S[R|X(0) ,W(R) =T] = 2q*n..(T). (2.5) 

A(0) j-l 4 4 



Then in terms of the differential equations (2.3) 
multiplying through by j/r (j) , one obtains, with 

conditions m*(0) = 0, 

0 



K) 



m 



* ('ll - Z (j/r (j) ) q^+ Z qj (j/r { j) ) C -(X^+pj) 



(T) 



; after 
initial 
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( 2 . 6 ) 



N 

m* ( 1) = 2 (j/r (j) ) g-. 

4--x J 

Thus it fellows that the long-run conditional expeexed 
response time of the processor-sharing system is linear in 
the processing time requirement T: 

N> 

E[B|W(E)=T] = T2<j/r(1))q: 

j ^ 

= TE[ X (0) /r (X (0) ) ]. (2.7) 

Apparently no such simple form exists for Var[ R| W (R) =T ], 
although Mitra [Ref. 2] has given a formula for a particular 
case. It will be shewn, however, that the above variance is 
indeed proportional to T if T is large. 

D. MOMENTS AND VARIANCE OF RESPONSE TIME 

The conditional moments fer response time of a job 
requiring T units of processing time may be obtained by a 
similar derivation tc that used for the expected conditional 
response time. For example, to find an expression in differ- 
ential equation form of the second moment, one has to 
consider all the possible system changes during time period 
<0,h) as has teen done for the mean response time in 
previcus section. If the conditional second moment of 
response time of a tagged job that requires T units of 
processing time is: 

m2 (T) = E[R2|X(0)=j,W(R) =T], (2.8) 

*1 



then, the following results subsequently occur: 
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(2-9) 



m2 (T) -m2. (T- (r(j) /j) h) 

= 2mj (T- (r ( j) / j) h) - ( Xj + ^ ) m 2 ^ (T- (r (j) /j)h) 

+ X^m2. + t (T-(r(j) / j) h) + Ujm 2 ^ (T- (r ( j) / j) h) . 

As h > 0 one cttains the differential equations: 

(r(j)/j)[dm2 (-r)/dT] = 2m^. (T) - ( X* + ) m 2 ^ (T ) 

+ (T)+ f\i m 5 \i-i (T) * (2 * 10) 

Again, the distribution found in (2.4) can be used to 
remove the condition that the job enters to find j-1 ethers 
in the system. 

The variance may then be computed by usual formula, i.e. 

Var[R (T) ] = E[ R2 (T) ] - [ E [ R (T ) ]]2. 

Likewise, the differential equations for the third and 
fourth moments, m*. (T) and m 4 .(T), may be obtained by the 

J 

procedure used to evaluate the first and second moments. The 
expressions for these moments are as follow: 

(r (j)/j) [dm3 (T)/dT] = 3m 2 ^ (T) - ( X-+ py 0 3.(T) 

+ ' {2 -" ] 

(r ( j) / j) [dmt(T)/dT] = 4m* (T) - (Xj + ) mMT) 

+ X;m 4 (T) + u ; mt (T) . (2. 12) 
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Cnee the condition of initial system state is removed 
using the expression cf (2.4) we can compute the third and 
fourth central moments by expanding the powers in order to 
calculate them in terms of moments around the origin 
cbtained frcm solving the system of differential equations 
described above. The central moments may be expressed in the 
following forms: 

E[ (E (T) -E[ R (T) ]) 3 ] = E[R 3 (T) ]-3E[ R 2 (T) ]E[R (T) ] 

♦ 2[ 2[ R (T) ]] 3 

E[ (E (T) -E[R(T) ]) 4 ] = E[ R 4 (T) ]-4E[ R 3 (T) ]E[ R (T) ] 

♦ 6E[ E 2 (T) ][ E[R (T) ]] 2 -3[ E[R (T) ]] 4 . 

The skewness and kurtcsis of response time are then computed 
as fellows: 

Skewness = E[ ( E (T) -E[R(T) ]) 3 ]/(Var[ R(T) ]) & , 

Kurtosis = {e[ (R (T)-E[R (T ) ]) 4 ]/ ( (Var[ R (T) ]) 2 )^ -3. 

\ 

E. NUMERICAL RESULTS 

The conditional expected response time mj(T) and the 
conditional moments m 2 ; (T) , m 3 .(T) and m 4 .(T) can be computed 
by solving the differential equations (2 . 10) - (2. 12) using 
numerical methods, i. e. either linear or Runge-Kutta 
methods. Once these results are obtained, the condition 
that the tagged job enters to find j-1 others in system is 
removed. Hence we will obtain the mean and the second, 

third and fourth moments of response time of a job that 
requires T units of processing time. These values can then 
be used to compute the central moments, and eventually allow 
us to determine the variance, skewness and kurtosis for the 
distribution of response time. 
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Table I shows the means, variances, skewnesses and 
kurtcsises cf response time cf a job requiring T units of 
processing time for a system cf 2 terminals with arrival 
rate X = 1 and service rate p = 2 . We see that as the 
required work time becomes large the distribution of the 
response time is moderately close to a symmetric one, since 
the skewnesses are small. The kurtosis is also approaching 
zero as the required work time becomes large. This suggests 
that the distribution of the response time may be 
approximated by a normal distribution for large required 
work time. 



TABLE I 

Numerical Results for 2 Terminals 



X = i, y = 2 



Time 


Mean 


Var iance 


S ke wness 


K urtosis 


O.IOCO 


0. 1335 


0. 0020 


0.6633 


- 1.3415 


0.2000 


0. 266 8 


0. 0 074 


0.7078 


- 1.3042 


C.30C0 


0.4002 


0.0 152 


0.7053 


- 1.2428 


0.5000 


0. 6668 


0. 0 358 


0.6876 


- 1.0823 


1.0000 


1. 3325 


0. 1 031 


0.5729 


-0.6024 


2.0000 


2. 67 19 


0. 2656 


0.5118 


-0.4626 


3.0000 


4 . 00 8 4 


0.4569 


0.4614 


-0.3802 


5 . 00 CO 


6. 68 15 


0.7711 


0.2554 


-0.1976 



i 1 
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III. si MO I AT I ON FOR ONE JOB TYPE MODEL 
A. I NTRCDUCTION 

The numerical method of computing the moments of the 
conditional response time of a tagged job that requires seme 
fixed ameunt of processing time indicated in the previous 
chapter is generally sufficiently accurate, especially if 
carried cut by the Runge-Kutta method. However, the disrri- 
bution of the response time is also of interest. We will use 
simulation to study this distribution. We will describe a 
simulation routine for response time of a jcb requiring a 
fixed ameunt of processing time for the model with one job 
type described in chapters I and II. 

The conditional response time of a tagged jcb that 
enters tc find j- 1 ethers initially present in the system, 
and requires T units of processing time can be simulated for 
the mcdel if the jet submission rate to the processor of 
each terminal and the processing rate of the processor, i.e. 
A and p, are known. Under Markov assum pt ions, the number of 
jobs, including the tagged one, in the Processor-Sharing 
system which consists of one processor and N terminals is 
considered as a birth and death process with transition 
rates Aj = X(N-j)and jAj * JMj-1) r ( j) /j, where r(j) is 
defined as c fraction of time the processor actually spends 
processing when there are j jobs being processed including 
the tagged job. Thus the interarrival time and the departure 
time (work completed) of the jobs in the system are exponen- 
tially distributed with parameters Aj and ft re specti vely. 
We use the LLRANDC Mil package available for the Naval 
Postgraduate School computer system to generate the two 
exponential times with rates and respectively. 
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The Generated arrival and departure times are compared 
and the sojourn time in state j is determined as well as the 
next state cf the system and the amount of processing time 
the tagged job gets from the processor during the sojourn 
time. We •‘■.hen repeat the procedure until the accumulated 
processing time for the tagged job meets the requirement of 
work required to completion. 

B. 1CRK TIHE 

It turns out to he especially convenient to measure time 
in terms of the amount of actual work or processing that has 
been accomplished on the tagged job. Let C (w) denote the 
number of jcbs undergoing service at a moment when exactly w 
units of processing have been accomplished on the taqged 
job. We will also assume r(j) = 1 for all j. The rate of 
accretion cf clock or response time at work time w is C(w) : 
if C (w) - 1 then the tagged job is alone and response 
(clock) time and work time advance at the same rate, while 
if C (w) = 17 the tagged job is accompanied by 16 ethers and 
17 units cf response time accrue for every single work time 
unit. It fellows that the response time for the tagged job 
requiring T units of processing time is simply 

R (T) = Jc(w)dw. 

o 

The process {c(w)"J is a birth and death process related to 
X(w) . It has arrival and departure rates Xj = Aj(N-j) and 
pj = jij. All the simulations described in this thesis will 
be dene in work time. 

To obtain the conditional expected response time of a 
tagged jcb that requires T units of work time as in previous 
chapter, we remove the condition that the tagged job entered 
to find j-1 others initially present in the system by 
applying the same steady-state distribution cf the number of 
jobs in system, q , found in (2.4). 
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C. S3MUIATI0N FOR A 2-TERH INAL SYSTEM 

1 . Al qcri th m 

Ke will first describe 'the simulation by considering, 
a simple computer system which consists of one processor and 
only two terminals. Each terminal submits jobs to be 
processed by the processor at rate X and the processor has 
a service rate of p for jobs already present in the system. 
The service effort is allocated equally to all jobs present 
in the system at any time. Therefore, if a job requiring T 
units of work time enters tc find the system emp^.y, the 
arrival rate of the ether job will be X while there will be 
no departure. Similarly, if the job enters to find the other 
one already present in the system, there will be no arrival 
while the service rate will be pr(2)/2. 

To transform the rates into the terms of work time 
we multiply them by 1/r(1) and 2/r(2) respectively. Thus, 
the arrival rate, if any, becomes X/r(1) and the service 
rate, if any, is simply p. 

Eased on the above transition rates an algorithm to 
perform simulation for the conditional . response time and 
eventually the mean response time of a job requiring T units 
cf processing time will be given as follows. 

Alg orit hm tc simulate response time of a job 
requiring T units of proces sing time in a 2 -term inal sy stem . 

let w 0 = amount of work time remains to accomplish 
for the tagged job. 

c Q = amount of clock time accumulated towards 
the response time of the tagged job. 

Ste p : Set w Q = T and c 0 = 0 

S tep 2 : If the tagged job enters to find the system empty, 
otherwise go to step 3, generate an exponential time with 
parameter X/r(1). Call this t'. 
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a) If t* >w 0 , set the ccr.ditional respons® time 

R, - c 0 + w 0 /r (1) . 

STOP 

t) If t* < w 0 , set : 

w o * w o” t ’^ c 0 = c 0 + t»/r(1) . 

GO TO St ep3. 

Ste p 3 : If t he job enters to find another one already 

present in the system, i.e. j = 2, generate an exponential 
with parameter p . Call this t". 

a) If t" > w 0 , set the response time 

R z = c 0 + 2w o /r(2). 

STOP 

b) If t" < v D , set : 

w o * w 0 -t", c o ~ c o + 2t ,, /r (2) . 

GO TO Step 2. 

Repeat the above procedure until we obtain the 
conditional response times for both cases. 

To find the mean response time we use the long-run 
distribution of the number of jobs in system just after the 
tagged jcb entered, i.e. 

q j = cTT a-»\i-i = cTt-^r(j) , 

where j =1,2 and g t + g A s 1 and TT^ is the stationary 
distribution of the continuous time Markov chain, $X(t)^. 

The mean response time of a job requiring t units of 
work time is then 

I[R] = B,q, + R^g*, 

where R, ,R t are the conditional mean response times, given 
the tagged job enters to find the system empty and one job 
already present respectively, generated by the algorithm. 

The variance, skewness and kurtosis of the response 
time may also be obtained by deriving the usual central 
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moments. These calculations will be detailed in the next 
sect icn. 

2 • Numerical Re s uits 

The numerical results shown in Table II are obtained 
from the outputs of a computer program written in FORTRAN 




TABLE II 

Simulation results for 2 terminals 



X = 1, ^ = 2 



Time 


Mean 


Std .Dev. 


Skewness 


Kurtosis 


0.1000 


0. 1339 


0. 0452 


0.6839 


- 1.4462 


C .2000 


(. 0006 ) 
0. 2648 


0. 0851 


0.7550 


-1.2457 


C . 3000 


(. 001 4 ) 
0 . 40 3 1 


0. 1 229 


0.6459 


- 1.3044 


C . 5000 


(.0027) 

0.6688 


0. 1 913 


0.6477 


-1. 1835 


1.0000 


(. 0047) 
1 . 36 69 


0.3 200 


0.6017 


-1.0297 


2 .0000 


(. 0098 ) 
2.6864 


0.5051 


0.5690 


-0.4870 


3.00C0 


(. 0157) 
4.0128 


0.6 516 


0.5184 


-0.2896 


5 .0000 


(.0211) 

6.6863 


0.8224 


0.2974 


-0. 1623 



(. 0269) 
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using the above algorithm to simulate the conditional 
response time, given the initial system state when rhe 
tagged jcb arrives. The steady state distribution is then 
used to evaluate the unconditional moments, and measures of 
skewness and kurtosis for various work time requirements of 
the jcb. The values between parentheses below the means are 
their corresponding standard errors which depend on the 

number of simulation replications. These outputs are evalu- 
ated based on 500 replications of the response time for each 
initial condition. The r(j) *s are all assumed to be unity. 

Note that the moments obtained from the simulation 
agree well with those obtained by solving directly the 

system cf differential equations for the moments of the 

response times. This fact provides a check for the simula- 
tion. The simulated response times show diminishing values 
of skewness and kurtosis as the required work time becomes 
large, again suggesting that there may be an increasingly 
accurate normal approximation to the response time 

distribution. 



D. SIMULATION FOR AB H-TERMINAL SYSTEM 



1 . Alg cri th m 



Now, consider a mere general computer system with 
one processor and N terminals. As before, each terminal has 
a submission rate X to the processor and the processor 
processes each job to completion with rate p . The alloca- 
tion cf processing time always follows the method of 
"Processor- Sharing" . 

The simulation for response time of a jcb requiring 
T units cf processing time will be done under the condition 
that when the job arrives there are j terminals active, i.e. 
j jobs, including the tagged one that just arrived, are 
being served by the CFO. Here, j can be 1,2,...,N. 
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Under Processcr-Sha ring scheduling, if j jobs are 
present then in a short time interval of length h the tagged 
job gets hr(j)/j units of work done. Thus, if W (t) is the 
amount of work done cn tagged job by the time in has been in 
the system for t units of clock time, and if the number of 
jobs in system during this time t is j, then W(t) = tr{j)/j. 

As long as W (t) is less than the required amount of 
work T for the tagged job, we will have to accumulate the 
amount of work done computed according to the number of jobs 
in system at that time. The conditional response time will 
be the clock time t for which the accumulated completed work 

ft 

time ) W ( t * ) dt ' is egual to T. 

o 

Again it is convenient to measure time in terms of 
work time. The work time process, C(w), described in the 
previous section is a birth-death process with rates 

X(N-j) j = X j and (j” 1 ) • 1 < j < N . The response time 

is simply E (T) =ic(v)dw, if r (j) = 1. 

o 

lo simulate the work time process, we generate two 

\ \ 

exponential times with parameters Aj and ^ respectively. 

The minimum of the two will indicate which event, arrival or 
departure, occurs first. If an arrival occurs first and the 
accumulated completed work time is still less than the 
requirement, T, the number of jobs being processed by the 
CPU, i.e. system state, will be j+1. Likewise, when a 
departure occurs first the number of jobs for next 

computation will be j-1. 

The above observations allow us to construct an 
algorithm to perform a simulation for conditional response 
time and lead eventually to the estimation of statistics for 
the response time of a job requiring T units of processing 
time as follows. 

Algori th m to simulate respo ns e t ime of a job 

requiring T units of pro c essi ng time for an N-ter minal 
s ys tem , gi ven w hen the tag ge d j ob begi ns proce ssi ng there 
are ( j^l) i cbs also be ing p roces sed . 
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Let w Q = amount of work that remains to accomplish 
for the tagged job. 

c c = amount of clock time accumulated towards 
the response time of the tagged job. 

Step 2 : Set w Q = T and c 0 = 0. 

Ste p 2 : If j= 1 , i.e. the job enters to find the system 

empty, otherwise GO TC step 3, generate an exponential time 
with parameter X, • Call this t*. 

a) If t* > w 0 , set the response time 

H, = c 0 + w 0 /r ( 1) 

STOP 

b) If t' < w 0 , set 

w o = w o * t* 

C G = Co + t'/r ( 1) 

j = 2 

GO TO step 3. 

Ste p 3 : If j = 2,3,...,N-1, generate two exponential times 

« , 

with parameters Xj and Call them t' and t" respectively. 

a) If min(t* r t") > w Q , set the response time 

= c o + w o3/r(j) 

STOP . 

b) If min(t , r t M ) < w c : 

i) If min (t* ,t" ) = t* , set 
v c = w 0 - t« 

Co = c© + t‘ j/r (j) 
j = j + 1 

GO TO step 2 or 3 or 4 according to j. 

ii) If min (t* ,t ••) = t", set 
w 0 = w 0 “ t" 

c o = c o + tH j/r (j) 
j - j " 1 

GO TO step 2 or 3 or 4 according to j. 
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Ste p 4 : If j = N, i. e . all terminals become active, 

generate an exponential time with parameter Call this 

t". 

a) If t" > v 0 , set the response time 

R m = c 0 + w 0 N/r (N) 

STOP 

b) If t" < w 0 , set 

o w o u 

C 0 = c 0 + t ” N/r (N) 

j = N -1 

GO TO step 3. 

Each run of the algorithm for fixed initial j gives 
a realization of the conditional response time of the tagged 
job given there are (j-1) other jobs in the system when the 
tagged jet arrives for processing. 

2. Mom ent s of Res pons e Time 

The simulation based on the above algorithm provides 
a batch of conditional response times of a tagged jet for 
each initial system state. 

Suppose we simulate a batch of size K for each 
conditional response time at initial system state j, for all 

j's. 

Let R^ be the k-th realized conditional response 
time given the initial condition is j ; (that is, the tagged 
job arrives when (j-1) other jobs are being processed), for 
j = 1,2,.. . ,N and k = 1,2,. ..,K. 

Mathematically, we can use the averages of (R 
i = 1,2, 3, 4, over each batch to compute empirical first, 
second, third and fourth conditional moments given initial 
condition j respectively. To compute the unconditional 
empirical moments for response time of a tagged job that 
requires T units of processing time, we can multiply the 
j-th conditional empirical moment by the steady-state 
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and sum 



probability gj given by (2.4) 
j = 1,2,...,N. The empirical mean, 
fourth central moments then are 
expansions, i.e. 



variance 



f 



cc mpu ted 



over all 
third and 
by power 



/V 

EC E (T) ] 


N 


/\ 

Var[R (1) ] 


Ki 

= 2??q. 
4 4 


A. 

E[ (F(T)-R) 3 ] 


= 

4 


A 

E[ (R (T) -R) 4 ] 


*4 

» 25>9i 
4 4 



= R 
-(R) 2 



!sl __ _ 

-3S ^a.fq. +2(8) 3 




4 

r 



(3.1) 



vc 

where R l . = (2 b ;i .)/K, for i = 1,2, 3, 4. 

j k»* 4 

However, in practice the above procedure can be 
numerically unstable since the averages of the second, third 
and fourth moments over the batch may be very large numbers. 
Hence, when we add or subtract these numbers to compute the 
central moments, it is possible that the computation 

produces round-off errors which may be substantial. 

Therefore, we would rather rewrite the central moments in 
terms of conditional expectations, i.e. 



E[ (R-E(R)) 1 ] = E[E[ (B-E(R) t | X (0) ] ], i=1,2,3,4. (3.2) 



where X(0) is the number of jobs requesting processing by 
the CFU , including the tagged job, when the tagged job 

arrives. This allows us to obtain the central moments in a 

more numerically stable manner. Further details will be 
shown for the computations of variance, skewness and 
kurtosis of the response time. 
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3. 



Commutation cf Simulated Va rian ce 




Let R- =* (ZR-,l)/K and R = 2 R; q : r than the 

*4 u * * ; . 4 0 



estimated variance 




vc N» 





VC *0 



K 




the estimated variance becomes 



This is the sampling version of the formula 

Var [ R ] = E[ Var (R | X (0) ) ]+Var[ E (R | X (0) ) ], 

which is a known general result that applies to any random 
variable, R, that also depends upon another random variable, 
namely X(0). The first component represents the overall 
variability of R for a fixed value of X(0), and the second 
component represents the variability of R due to the 
variability in X (0) • 

4 . Computation cf Simu lat ed Skewness 



the third estimated central moment of the response time by 
rewriting it in a conditional expectation form as we have 
done for the computation of the variance. The third central 
moment is derived as shown below. 



To compute the estimated skewness we first compute 




K 
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EC ( R jk' R) ^ = 



K NJ 

1 Z 2 (B iw-W s,3 *i 

K 

KN 

J.I 2 c <a A- B i | 3 + 3 (S 4 k- R i> 2 ' B r B) 

K k-ijsi 



+ 3(R-^-R i ) (R--R) 2+ (Hj-R) 3 ]qj 



We can remove the 3-rd component on the right hand side, 

vc _ 

since 

E iW"Rj ) /K = °* Thu s 

**' VC NJ VC N 



T? 



[,R. U -R,3 ] = J_X2 <R jW- R 4» 3 ^ +3 II (H A- R 4 ,2(R i- 5) ^ 

K k-' ^ ks\ 



^(R--P)3g 



sl*‘ 



The measure of skewness of response time is then 



SkewnessC R^] = E C < E ik~ R ) 3 } • 

(Var[Rj k ]) 3iz 

5 • Com nut ation of Simulated Ku rt os is 

We start by rewriting the expression for the 
estimated fourth central moment as follows: 



/V 

S[ (E^-R) 4 ] 



K- M 

K V*\ g 

- iii<*aw- r i* f i- 5 ) 4 54 

K k*>\ 

= life (Rj k - R j > 4+4 > 3 < R a - R > 

K k-u=- 



+ 6 (R^ -Rj ) 2 (R.-R) 2 + 4 (Rj k -Rj) (Rj-R) 3 



+ (Rj - R) 4 ]q * . 
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by removing the 4-th term on 



We -then simplify, as before, 

the right hand side. Hence, 

K Ki 

E[ 

K 

K H 



X Vi 



<B jk -R)«] = 2.22 ,B iw- R i)*^ + i22< R iu- R i ,3(E r 5) ^ 

K k=\4-< k k‘'i s ’ 



Vi 



+ 6 2Z (B uk- R j > 2 < R j - R) ^ + 2 (R i - R ) 
Y k?« J-» Ji ' 



Therefore, the measure of kurtcsis is 

Kurtosis C^ k ] = EC (RjW-a) 4 3 • 

(Var[R ik ]) 2 

Since for the normal distribution the kurtosis has the value 
3, we then substract- 3 from the kurtosis computed above. Sc 
the new value of kurtosis will be 0 when the distribution of 
response time has the normal degree of kurtosis. 



6. Sta nda rd Error of the Mean Res pons e T ime 

In order to assess the accuracy of the simulated 
average response time, we may compute a standard error for 
the mean response time of a tagged job that requires T units 
of work time from our batches of simulated conditional 
response times. 

We have derived previously that the mean response 



time is 






R = 



Kl 



1-' 



X 

K * ' 



Now, we apply a property of the variance function by consid- 
ering q and K fixed constants and noting that the Rj^’s are 
obtained from independent realizations. This allows us to 
write the estimated variance of the expected response time 

as fellows : 

^ /v N K 

»arfE[B-. ]] = i2.(1.2.<Rji -R; ) 2 > 9; 2 
JK * k --' 
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To obtain the standard error of the mean response time we 
simply take the square root of Var[E[R ik”- 

7 i, Numerical Re sui ts 

Tables III, IV and V show the outputs from a simula- 
tion program based cn the previously described algorithm. 
The number of replications for each initial condition is 



TABLE III 

numerical results from simulation 



N = 10, X = 15, = 100 



Time 


Mean 


Var iance 


Ske wn ess 


Kurt osis 


C.01C0 


. 040368 


.000295 


. 119865 


-.715162 


0.0250 


(. 000 177) 
. 1 00 5 1 0 


.00 1405 


. 088115 


-.712345 


0.0375 


(. 000503) 
. 151623 


.002508 


.015783 


-.587745 


0.C500 


(. 000733) 
. 201580 


.003865 


-.046461 


-.572722 


0.0625 


(.000952) 
. 251340 


.004953 


-.012371 


-.510326 


0.10C0 


(. 001092) 
. 4 02 9 1 6 


.00 8842 


-.092651 


-.378387 


0.15CO 


(. 001 510) 
.607487 


.01 3806 


-.061429 


-.186003 


0 .2000 


(. 001 935) 
. 806743 


.01 9704 


-.023100 


-.130595 



(. 002303) 
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TABLE 17 

Numerical results from simulation 





N = 10, 


X = 25, 


V* = ioo 




Time 

0.0100 


Mean 


Var iancs 


Ske wn ess 


Kurt os is 


. 060567 
(. 0001 92) 


.000253 


-.773193 


. 685650 


0.0250 


. 1 50692 
(. 000467) 


.000992 


-.717666 


. 637294 


0.3750 


. 226364 
(. 0006 52) 


.00 1775 


-.697005 


. 532480 


0 . 05 CO 


.302138 
(. 000791) 


.002466 


-.662308 


. 538648 


0.0625 


. 378 1 30 
(. 000925) 


.003266 


-.649630 


. 527906 


0.10C0 


. 6 03 5 8 4 
(. 001 228) 


.00 5601 


-.538279 


. 509166 


Ihe 


numbers below 


the means 


are their 


stan dar d 



500. 

We can see that the results in the tables indicate a 
somewhat sjmmetric distribution for the response time 
(skewnesses are very small) , and the kurtosises do not 
strongly indicate rcn-nor mality (they decrease towards 
zero) , especially when the processing time requirement 
becomes large. The kurtosis values in table III seem to 
indicate smaller tails than these in table IV, and the skew- 
ness values indicate that we have a more symmetric distribu- 
tion in the case X = 15 than when X = 25 for an equal 
|Li = 100. In the next chapter some normal approximations to 
the response time distribution will be described. 
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TABLE V 

Numerical results from simulation 



N = 2 5, X = 5, |Jl = 100 



Time 


Mean 


Var iance 


Skewness 


Kurtosis 


0.0100 


.063016 
(. 000202) 


.001011 


. 346171 


-.463719 


0.0250 


..158 88 4 
(. 000 6 27) 


.005204 


.213798 


-.555656 


0.0315 


. 229094 
(. 00 100 6) 


.010175 


. 170748 


-.541305 


0.0500 


. 3 1602 1 
(.001354) 


.01 5985 


. 159817 


-.565249 


0. 0625 


. 3 847 80 
(. 00 1686) 


.02 1523 


. 11 7365 


-.496104 



Time 


N = 25 
Mean 


, X = 10, 

Var iance 


Y = 100 
S ke wness 


K urtosis 


0.01C0 


. 149847 


.000659 


-.527812 


. 471482 


0.0250 


(. 000252) 
.375932 


.002529 


-.644450 


. 428531 


0.0375 


(. 000588) 
.562173 


.004470 


-.667446 


. 366822 


C.C5C0 


(. 000834) 
.750556 


.006467 


-.641420 


. 314407 


0.0625 


(. 001 020) 
.938072 


.008259 


-.593361 


. 275313 



(. 001 165) 
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17. NORMAL JIPBOXIBATION FOR RESPONSE TIME 
A. INTRODUCTION 

The Markov assumptions we make on the processor-sharing 
system allow us to infer that the distribution of the 
response time of a tagged job that requires T units of 
processing time may be approximated by the normal distribu- 
tion when T is large and/or when the system is in heavy 
traffic. 

Twc methods are used to argue the approximate normality 
of the distribution cf response time. One is based cn the 
Central limit Theorem for additive functionals of a birth 
and death process, and the ether follows from a heavy- 
traffic diffusion approximation of the birth and death 
process. The formulas to compute the approximate mean and 
variance will be described. More details concerning the 
analytic ferm of the approximations are given by Gaver, 
Jacobs and Latouche. [Ref. 3] The approximations will be 
compared with the results freir simulation to study their 
accuracy. 

As mentioned before, the Central Limit Theorem for addi- 
tive functionals of Markov processes allows the conclusion 
that the accumulated work accomplished in time t* of a job 
requiring a large amount of processing time, T, is approxi- 
mately normally distributed. This in turn allows the 
conclusion that the corresponding response time is also 
approximately normally distributed. Hence, we will start by 
considering W(t*)# "the total work expended by the computer 
on the tagged job by clock time t' after its arrival, given 
that the tagged job requires exactly T time-units of work 
for completion. 

It is ebserved that if when a job arrives there are 
X(0) = j customers, including the new arrival, present in 

the system for processing, then: 



36 



W(t') 



r 



X c (0) = j > 1 , 



(4.1) 



| (r (X c (u))/X t (u))du 



where X^(t) is the number of jobs at the service s tag* at 
clock tine t. 

From this an appropriate central limit theorem for W (t) 
can be established by using results for finite fciri h-and- 
death models [Ref. 8] or by making use of the theory- of 
cumulative processes. [Ref. 9] We note here that the latter 
development of the central limit theorem is adaptable to 
models mere general than the simple birth- and-deat h process. 

In the case in which the system is in heavy traffic we 
can approximate ^X c (t);t>0 3 ^y an Ornstein-Uhl enbeck 
process, see e.g. Iglehart. [Ref. 10] The process W(t*) is 
then approximated by an integral of an Ornstein-Uhlenbeck 
process. A normal approximation for the response time 
distribution then follows. 

After deriving seme formulas for the above two methods 
cf approximation, we will make comparison for goodness of 
fit of those approximations to simulation data. 

E. APPROXIMATION BY CENTRAL LIMIT THEOREM 

1 . A C ent ral L iff it The or em for W ( t) 

Under Markov assumptions throughout the processor- 
sharing system, the number cf jobs being at service stage at 
clock time t, X t (t), is a finite ergodic stationary time 
reversible Markov chain. 

If we define a function f (X (t) ) = r (X (t) ) /X (t) , then 

as outlined in Keilscn [Ref. 8] the process in equation 
(4. 1) may te proven in a variety of ways to be asymptoti- 
cally ncrmal in distribution for large t. Hence, the 
accumulated accomplished werk-time at time t, W(t), 
satisfies a central limit theorem. 
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In order to apply the central limit theorem derived 



ty Keilscn we will have to redefine the infinitesimal gener- 
ator according to the number of jobs in system without 
including the tagged cne. 



— -> X* (t+h) = j-1 : |A-^hj/(j+1)+o(h) 

---> X’ (t+h) = j : 1-(X j+ ,+ |A J>( j/(j+1))h + o(h) f 

for j = 0,1,..., N'=N-1. 

The process in equation (4.1) then becomes 

t 

W(t) = \ f (X» (u) ) du, (4.3) 



where f(X'(u)) = r (X • (u) +1) / (X « (u) + 1) . 

We can now express a statement for the central limit 
theorem as : 



The relevant generator is now 



X' (t) = j > X* (t+h) = j+1 : X- h+o(h) 

4 ^ » 



(4.2) 



0 



W ( t) - ft > N (0,1) , as t > 0 ° 

<*rr 



( 4 . 4 ) 



where the constants ■? and are such that 



N 




(4.5) 



<J 2 = 2[f (0) ,f (1) , . . . , f (N * ) ] 




'f ( 0)1 (4.6) 

icn 
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